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Abstract. 

The reanalysis data sets provide important sources for investigating the 
climate in Antarctica where stations are sparse. In this paper, we compare 
the 2-meter-near-surface temperature data from 5 major reanalysis data sets 
with observational Antarctic stations data over the last 36 years: (i) the Na¬ 
tional Centers for Environmental Prediction and the National Center for At¬ 
mospheric Research Reanalysis (NCEPl), (ii) NCEP-DOE Reanalysis 2 (NCEP2), 
(iii) the European Centre for Medium-Range Weather Eorecasts Interim Re¬ 
analysis (ERA-Interim), (iv) the Japanese 55-year Reanalysis (JRA-55), and 
(v) the National Aeronautics and Space Administration (NASA) Modern- 
Era Retrospective-analysis for Research and Applications (MERRA). In our 
assessment, we compare (a) the annual and seasonal trends obtained by lin¬ 
ear regression analysis, (b) the standard deviation around the annual trends, 

(c) the detrended lag-1-autocorrelation C(l), (d) the Hurst exponent a that 
characterizes the long-term memory in a record, and (e) the signihcance lev¬ 
els of the warming/cooling trends. We hnd that all 5 reanalysis data sets are 
able to reproduce quite well the long-term memory in the instrumental data. 

In contrast, C'(l), which is needed as input for the conventional signihcance 
analysis shows fully erratic behavior. The observational warming/cooling trends 
in East and West Antarctica are not reproduced well by all reanalysis data 
sets, in particular NCEPl, NCEP2, and JRA-55 show spurious warming trends 
in many parts of East Antarctica, even in those parts where cooling has been 
observed. In contrast, the standard deviation around the trends is quite well 
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reproduced by all reanalysis data sets. In the Peninsula where the station 
density is quite high, the performance of the reanalysis data is considerably 
better. It is remarkable that all reanalysis data sets as well as the observa¬ 
tional data show (under the assumption of a long-term persistent process) 
that in the considered time period since 1979 the warming in the Peninsula 
is not signihcant with p values well above 0.1. 
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1. Introduction 

In recent years, the warming patterns of Antarctica have received much attention [e.g., 
Turner et al, 2005; Steig et al, 2009; Ding et al, 2011; Bromwich et al, 2013]. The 
large Antarctic Ice Sheet is one of the crucial tipping elements in the global climate 
system [Lenton et ai, 2008], and a change of the dynamics and mass balance of the 
Antarctic Ice Sheet may have widespread implications, contributing and hnally dominat¬ 
ing the global and regional sea level rise [Turner and Marshall, 2011]. Thus, addressing 
the Antarctic temperature change in a long-term context and determining its signihcance 
is an important issue [Schneider et ai, 2006; Steig et ai, 2013; Bromwich et ai, 2013; 
Bromwich and Nicolas, 2014; Bunde et ai, 2014; Ludescher et ai, 2015; Tamazian et ai, 
2015]. However, this is quite a challenging problem due to the lack of long observational 
data sets. 

Accordingly, reanalysis datasets that are able to £11 the gaps in data-sparse regions 
and help give the full physical picture of the climate change in Antarctica are highly 
needed and appreciated [Ding et ai, 2011, 2012; Bromwich et ai, 2013]. Reanalysis data 
also play a central role in reconstructing Antarctic near surface temperature [Monaghan 
et ai, 2008; Steig et ai, 2009; Nicolas and Bromwich, 2014]. The most commonly used 
physical quantities are mean sea level pressure (MSLP), geopotential height at 500-hPa 
(Z500), near surface air temperature (at 2 meter, T 2 m), as well as geopotential height at 
higher pressure levels such as 30-hPa {Z30) [Thompson and Solomon, 2002; Ding et ai, 
2011, 2012; Bromwich et ai, 2013]. 
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Until now, several reanalysis datasets have been released. The most commonly used 
datasets include the National Centers for Environmental Prediction (NCEP) and the Na¬ 
tional Center for Atmospheric Research (NCAR) reanalysis (hereafter, NCEPl), NCEP- 
DOE Reanalysis 2 (hereafter, NCEP2), the European Centre for Medium-Range Weather 
Forecasts (ECMWF) Interim Re-Analysis (hereafter, ERA-Interim), the Japanese 55-year 
Reanalysis (hereafter, JRA-55), and the National Aeronautics and Space Administration 
(NASA) Modern-Era Retrospective-analysis for Research and Applications Reanalysis 
(hereafter, MERRA). Besides Antarctic research, these datasets are also widely used to 
study atmospheric dynamics and provide invaluable data sources for interdisciplinary re¬ 
search [e.g., Rozanov et ai, 2005; Rodger et ai, 2008; Sepp'dla et ai, 2013; Lam and 
Tinsley, 2015; Regi et ai, 2016; Gozolehiani et ai, 2011; Yamasaki et ai, 2008; Donges 
et al, 2009; Berezin et al, 2012; Wang et ai, 2013; Ludescher et al, 2013, 2014], Accord¬ 
ingly, the reliability of these reanalysis data sets is of great interest. 

In this paper, we are interested in the quality of the near-surface (2m) temperature 
data provided by the 5 reanalysis data sets over Antarctica. Previous evaluations of 
the performance of reanalysis data [Hines et ai, 2000; Marshall and Harangozo, 2000; 
Marshall, 2003; Bromwich and Fogt, 2004; Bromwich et ai, 2007, 2011; Cullather and 
Bosilovich, 2011; Bracegirdle and Marshall, 2012; Jones and Lister, 2015; Nicolas and 
Bromwich, 2014] concentrated mainly on the biases of the data and the temperature 
patterns. Here we assess the reanalysis skills by focusing for the hrst time on (a) the 
annual and seasonal trends obtained by linear regression, (b) the standard deviation 
around the annual trends, (c) the detrended lag-l-autocorrelation C(l), (d) the Hurst 
exponent a that characterizes the long-term memory in a record, and (e) the significance 
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levels of the annual warming/cooling trends. We concentrate on the time span between 
January 1979 and December 2014, when the modern satellite data were assimilated. 

It is obvious that the magnitude of a trend and the fluctuations around the trend line are 
central quantities of a temperature record, in particular in the context of global change. 
For describing the persistence of a record, C'(l) and a are central quantities. In most 
previous attempts to obtain quantitatively the signihcance of a warming or cooling trend 
it has been assumed that the data are short term persistent such that the detrended lag- 
s-autocorrelation function C(s) decays exponentially, C(s) = C(l)“^. As far as we know, 
there are no theoretical or observational arguments why atmospheric (or sea surface) 
temperature should decay exponentially. The exponential decay has been assumed as 
the simplest way of describing the persistence of the record. Furthermore, there are no 
theories that describe the value of C'(l) as a function of the location of the considered 
station. Since the persistence is fully determined by C'(l) in this case, the signihcance of 
a trend is also determined solely by C(l) [Santer et ai, 2000], making C(l) an essential 
quantity. 

In the past few decades it has been realized based on data analysis, that temperature 
records are not short-term persistent but long-term persistent all over the globe [e.g., 
Hurst, 1951; Mandelbrot and Wallis, 1968; Bloomfield and Nychka, 1992; Koseielny-Bunde 
et ah, 1998; Malamud and Turcotte, 1999; Fraedrich and Blender, 2003; Eichner et ai, 
2003; Monetti et ai, 2003; Vyushin et al, 2004; Cohn and Lins, 2005; Kirdly et al, 2006; 
Rybski et ai, 2008; Lennartz and Bunde, 2009; Franzke, 2010, 2012; Lovejoy and Schertzer, 
2013; Ludescher et ai, 2015; Yuan et ai, 2015]. In long-term persistent records, C(s) has 
been found not to decay exponentially, but by a power law, C(s) oc s~'^. The exponent 
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7 can be obtained best by using the Detrended Fluctuation Analysis (DFA) [Peng et ai, 
1994; Kantelhardt et ai, 2001] (see Methods Section), where the Hurst exponent a = 1 — 
7/2 is measured. Typically, for coast line stations a is around 0.65 (±0.10), while for island 
stations and sea surface temperature a is signihcantly larger, being around 0.75 (±0.15) 
for island stations and around 0.8 (± 0.10) for sea surface temperatures [Koseielny-Bunde 
et ai, 1998; Malamud and Turcotte, 1999; Fraedrieh and Blender, 2003; Eichner et ai, 
2003; Monetti et ai, 2003; Kirdly et ai, 2006; Franzke, 2010, 2012; Ludescher et ai, 2015; 
Yuan et ai, 2015]. The error bars refer to the 95 percent conhdence interval. Recently, it 
has been demonstrated explicitly by using DFA2 that the Antarctic temperature records 
cannot be considered as short-term persistent [Bunde et ai, 2014; Ludeseher et ai, 2015; 
Yuan et ai, 2015]. Instead, as for the rest of the globe, also the Antarctic temperature 
data are long-term persistent, with a values similar to those found in other locations 
around the globe. 

There is no comprehensive theory that describes the origin of the long-term persistence 
in temperature data. However, studies of general circulation models (AOGCMs) show 
that apart from the inertia of the oceans, the natural forcings play an important role, 
in particular volcanic forcing [Vyushin et ai, 2004]. Since the atmospheric and the sea 
surface temperatures are long-term persistent, the Hurst exponent a is the central quantity 
that quantihes the temperature ‘landscape’ of a record, and it is important to know if 
the reanalysis data are able to reproduce proper Hurst exponents or not. From the Hurst 
exponent of a long-term persistent record one can derive quantitatively the statistical 
signihcance of a warming or cooling trend [Lennartz and Bunde, 2009, 2011; Tamazian 
et ai, 2015]. Since in the context of global change the statistical signihcance of a trend 
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is of great interest, we also compare their values for the different reanalysis data sets in 
Antarctica. 

In this article, we are not the hrst to study the temperature patterns in Antarctica 
and the long-term persistence in the near-surface temperature data. We do not aim here 
to establish a theory for the various temperature patterns as well as for the long-term 
persistence with the slightly varying Hurst exponents. Instead, we wish to quantify the 
cooling/warming trends and the Hurst exponents in the observational and the reanalysis 
data and compare them to each other. This comprehensive comparison is important since 
the observational data is sparse in Antarctica, and we need to know to which extent we 
can rely on the reanalysis data sets, in order to investigate the Antarctic temperature 
change as well as the teleconnections with other regions in the globe. Our study shows 
that all reanalysis projects are unable to describe satisfactorily the annual and seasonal 
trends in West and East Antarctica where the station data are sparse. Regarding the 
dynamical behavior we hnd that 0(1) fluctuates very strongly in all reanalysis data sets, 
such that different reanalysis sets would provide very different persistent properties for the 
same station, ranging from intermediate anti-persistence to strong persistence in case the 
conventional picture of a dominating short-term persistent process was correct. We show 
that this is another indication that the Antarctic temperatures are not mainly short-term 
persistent. 

Indeed, one of the remarkable results of this study is that all reanalysis data are able 
to reproduce the long-term persistence of the observational temperature records, with 
comparable Hurst exponents. The second remarkable result is that all reanalysis data 
sets except JRA-55 describe the situation in the Peninsula (which is considered to be one 
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of the fast warming regions on Earth) reasonably well. The results show that from 1979 
on the warming is not signihcant, with p values well above 0.1. Accordingly, after 1979 
the temperature trends in the Peninsula are well within the bounds of natural variability, 
in agreement with the results of Ludescher et al. [2015] and Turner et al. [2016]. 

This paper is organized as follows. In section 2, we provide the source of the Antarctic 
stations data and describe the hve reanalysis data sets. In section 3, we present the results 
of our assessment. Section 4 concludes the article with a short summary. The Method 
Section 5 describes the methods, including long- and short-term persistence, detrended 
fluctuation analysis (DFA2), and statistical signihcance analysis in detail. 

2. Data 

2.1. Observation dataset 

In this study, we use monthly mean observation T 2 m data (from January 1979 until 
December 2014) from 12 Antarctic stations (4 in West Antarctica including the Penin¬ 
sula and 8 in East Antarctica) provided by the British Antarctic Survey Reference 
Antarctic Data for Environmental Research project (READER) [Turner et ai, 2004] (see 
http://www.antarctica.ac.uk/met/READER/). The stations in the Peninsula are Belling¬ 
shausen, Rothera, and Faraday/Vernadsky, the West Antarctic station is McMurdo, and 
the East-Antarctic stations are Halley, Syowa, Mawson, Davis, Dumont-Durville, Mirny, 
and Amundsen-Scott (the South Pole). We have chosen these stations because they pro¬ 
vide us with the longest reliable temperature records and also have been subject of a 
recent study on the persistence of Antarctic temperatures and the signihcance of their 
warming/cooling trends [Ludescher et ai, 2015]. The READER dataset provides contin¬ 
uous observational temperature records for the Antarctic region. To hll the short temporal 
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gaps in the data we apply linear interpolation. In addition, because of the lack of long 
records of station data in the interior of the West Antarctica, we also analyzed the recon¬ 
structed data set at Byrd station [Bromwich et ai, 2013]. Figure 1 shows the locations of 
all stations studied here. At each location, we show the temperature change and the Hurst 
exponent that characterizes the long-term persistence in the considered time window. 

2.2. Reanalysis data 

We consider hve reanalysis datasets NCEPl, NCEP2, ERA-Interim, JRA-55 and 
MERRA, which are widely analyzed. NCEPl uses a frozen state-of-the-art global as¬ 
similation system [Kalnay et ai, 1996]. The data assimilation and the model used are 
identical to the global system implemented operationally at NCEP on January 11 1995, 
but with a reduced horizontal resolution of T62 (~ 209 km). The spectral model used in 
the assimilation system contains 28 vertical levels from lOOOhPa to 3hPa. Its temporal 
coverage is four times per day from January 1 1948 to the present day. 

NCEP2 is an improved version of the NCEPl model with the same horizontal and verti¬ 
cal resolutions, but fixed errors and updated parameterizations of the physical processes, 
such as the new boundary layer, new short wave radiation in the model and improved 
sea-ice SST helds [Kanamitsu et ai, 2002]. The data records range from January 1 1979 
to the present day. Both NCEPl and NCEP2 reanalysis use a three-dimensional vari¬ 
ational analysis scheme in the data analysis module. The major input observational 
data for NCEP1/NCEP2 are the NCEP global upper air Global Telecommunication Sys¬ 
tem (GTS) data from 1962 provided by the National Center for Atmospheric Research 
(NCAR). Another data source is the NCEP global surface GTS data from 1967. Both 
data include all available Antarctic stations. These input data are combined with other 
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datasets, such as satellite data, surface marine data, surface wind data and so on. There¬ 
fore, the output T 2 m is strongly affected by both the observational data and the model 
parameterizations [Kalnay et ai, 1996; Hines et ai, 2000]. 

ERA-Interim, on the other hand, uses a four-dimensional variational assimilation 
scheme with a twelve-hour analysis window, and the data assimilation system is based 
on a 2006 version of the ECMWF Integrated Forecast Model. The spatial resolution of 
the model is T255 (~ 80 km) on 60 vertical levels from the surface up to 0.1 hPa [Dee 
et ai, 2011]. The data is continuously updated in real time from January 1 1979. More¬ 
over, ERA-Interim and NCEP1/NCEP2 use different assimilation schemes of satellite 
data. While ERA-Interim assimilates raw satellite radiances, both NCEPl and NCEP2 
use satellite retrievals. Retrievals estimate the vertical temperature and humidity pro- 
hles through a series of empirical and statistical relationships, while raw radiances are 
direct measurements of atmospheric radiation acquired by the satellite sensors [Bromwich 
et ai, 2007]. Moreover, ERA-Interim reanalysis data uses the GTS surface data from 
both ECMWF and external institutions, such as NCEP/NCAR and Japan Meteorologi¬ 
cal Agency (JMA). 

JRA-55 is known as the second reanalysis project conducted by the JMA, which uses a 
constant state-of-the-art but more complicated data assimilation system compared with 
their Erst reanalysis data set. JRA-55 reanalysis mainly uses observational data provided 
by ECMWF, which includes both ECMWF and NCEP/NCAR surface and upper air 
observations from 1958. Therefore, it includes similar Antarctic stations as ERA-interim 
reanalysis. In addition, newly available observational datasets are collected whenever pos¬ 
sible, including those used in past operational systems and delayed observations as well as 


DRAFT 


January 11, 2017, 1:11am 


DRAFT 



X - 12 


WANG ET AL.: TESTING REANALYSIS DATASETS IN ANTARCTICA 


digitized observations. High-quality reprocessed satellite data are also assimilated where 
available. This reanalysis data covers date from the year 1958, when regular radiosonde 
observation began on a global basis [Kobayashi et ai, 2015]. 

MERRA is a NASA atmospheric data reanalysis for the satellite era using a major 
new version of the Goddard Earth Observing System Data Assimilation System Version 
five (GEOS-5). MERRA focuses on historical analyses of the hydrological cycle on a 
broad range of weather and climate time scales. MERRA also has very high spatial 
resolution (0.5° x 0.67°) that might show improved skills [Rienecker et ai, 2011]. MERRA 
reanalysis dataset mainly uses NGEP land surface observations from 1970. Therefore, all 
available Antarctic stations are also included as a part of input data. MERRA also 
used radiosonde data that were quality controlled by NGEP, with additional corrections. 
The conventional observational data used in MERRA include British Antarctic Survey 
radiosonde observational data. 

Here, we study the monthly mean T 2 m records in these hve reanalysis datasets. To 
compare with the observational station records we choose in the reanalysis records the 
nearest land point to a given selected station, since most stations analyzed are located 
near the Antarctic coast. However, if the nearest land point is more than 150 km away 
(only in the Antarctic Peninsula), we choose the nearest reanalysis grid point instead. 
Note that many previous studies used the dry adiabatic lapse rate (9.8 °Gkm“^ or 6 
°Gkm“^) to account for the Antarctic near-surface air temperature [Jones and Lister, 
2015; Braeegirdle and Marshall, 2012]. We do not need to use height adjustment in this 
study since all quantities we are interested in are independent of this correction. 
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3. Results 

3.1. Annual trends and standard deviation around the trend lines 

For obtaining the magnitudes of warming/cooling trends, we consider the annual near 
surface temperatures Tj, i = 1, 2, • • •, L = 36. We use linear regression analysis based on 
the least squares method, which minimizes the variances of Tj along the regression line 

Tj = ?7 + bi. (1) 

Accordingly, we dehne the total temperature change by A = b{L — 1). The standard 

/ L 

deviation around the regression line is a = \ (Ti — . The relative trend x relevant 

y 2=1 

for the statistical signihcance analysis is dehned by the ratio between the total trend and 
the standard deviation, x = A/a, as dehned by Tamazian et al. [2015]. 

Figure 2 compares, for 4 of the 13 stations (Dumont-Durville, Amundsen Scott, Rothera, 
and McMurdo), the annual READER temperature time series (upper curves) with the 
corresponding data sets of the 5 reanalysis projects considered here. The straight lines are 
the regression lines. The y-axis is in degree Celsius. To avoid overlapping of the data, we 
have added to the different reanalysis sets arbitrary offsets (for transparency since we are 
interested in the trends and the structure of the temperature landscapes). One can see 
that the observational temperature trends are not reproduced well by all reanalysis data. 
For Dumont-Durville, the observed temperature trend is negative, but two of the data sets 
(NCEPl and NCEP2) show a remarkable warming trend. For Amundsen-Scott, there is 
a moderate warming trend in the observational data. The reanalysis data show a mixed 
behavior, ranging from strong warming (NCEPl) to considerable cooling (ERA-Interim). 
In contrast, the variation of the data around the trend line is comparable in all cases, and 
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also the characteristic ‘mountain-valley’ structure of the READER data that is generated 
by their persistence properties, is roughly in line with the reanalysis data sets. 

Figure 3 shows the result of our quantitative analysis of A and the standard deviation a 
along the regression line. In the hgures, Bellingshausen, Dumont-Durville and Amundsen- 
Scott are abbreviated by Bell, DD and AS, respectively. In the Antarctic Peninsula, the 
observational data show warming trends at Faraday and Rothera, while in Bellingshausen 
there is no obvious temperature change in the past 36 years. Almost all reanalysis datasets 
show warming patterns except JRA-55, and the warming trends are in reasonable agree¬ 
ment with the observations. JRA-55, however, shows almost no temperature change in 
the last 36 years in the Peninsula, which is inconsistent with the observational records. 
In West Antarctica, however, the ERA-Interim and JRA-55 reanalysis data are in good 
agreement with the observations, while the NCEP2 reanalysis exaggerates the warming 
trends considerably. In particular, NCEP2 overestimates the trends A at Byrd and Mc- 
Murdo by a factor of 3.3 and 1.8, respectively. MERRA, on the other hand, show almost 
zero warming at Byrd and McMurdo. 

In East Antarctica, Figure 3 shows that the performance of NCEPl and NCEP2 is 
not reliable, with considerable warming trends at Halley, Casey, Dumont-Durville and 
Amundsen-Scott. Moreover, the JRA-55 reanalysis data also exhibits a strong warming 
trend at Casey. In contrast, the observational data at Halley and Casey show cooling 
trends with A = —0.26°C/decade and —0.23°C/decade, respectively. For Amundsen- 
Scott, NCEPl and JRA-55 exaggerate the warming trend A by a factor of 3.6 and 1.5, re¬ 
spectively. The performance of the ERA-Interim/MERRA reanalysis data in East Antarc¬ 
tica is considerably better. An exception for ERA-Interim perhaps is the negative trend 
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at Amundsen-Scott —0.4°C/decade) that is inconsistent with the observation. Indeed, 
recent careful investigations showed that ERA-Interim did not assimilate any observations 
for Amundsen-Scott before the start of 1986 [Jones and Lister, 2015]. 

The physical reason why West Antarctica as well as the Antarctic Peninsula exhibit 
a warming trend in the near surface temperature data has been addressed by previous 
studies. For example, the warming in West Antarctica during austral spring is partly 
due to the Pacihc South American (PSA) mode, especially PSA-1 mode that is a wave- 
train extending from the tropics to the high Southern latitudes [Schneider et ai, 2012]. 
Moreover, the warming in the Peninsula may be due to the extratropical Rossby wave 
train associated with tropical Pacihc sea surface temperature anomalies [Ding et ai, 2011; 
Ding and Steig, 2013]. 

For obtaining a quantitative measure for the goodness of the reanalysis data with respect 
to the observed annual temperature trends, we determined for each reanalysis data set 
the standard error Se with respect to the RFADFR data set, 

= [i ElA, - ADTT (2) 

-‘-'J i=l 

and the typical observational trend So, 

Y = Ai:(Af)TT (3) 

i=i 

Here, Aj is the temperature change of a specihc reanalysis data set at station i, 
i = 1, 2, • • •, 13, and Af is the corresponding observational temperature change from the 
READER data set. Table I shows the dimensionless relative standard error Sr = Se/Sq for 
all reanalysis data sets. We can obtain a threshold for Sr by comparing the observational 
data with their shuffled counterpart. For the shuffled data, Aj = 0 for all stations, which 
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leads to = 1. We consider a reanalysis data set as unsatisfying when the 5r is above 
the threshold. When the signs of Aj have the same signs as the Af of the observational 
data, then 5^ < 1. The lower is 6r, the better is the performance of the reanalysis data 
set. 

As expected from the foregoing discussion, NCEPl, NCEP2, and JRA-55 show a quite 
poor performance, with dr of the annual trend well above 1, dr = 1.44,1.66, and 1.21, 
respectively. The best performance can be found in ERA-Interim and MERRA, with 
dr = 0.96 and 0.77, respectively. The very poor performance of NCEPl, NCEP2, and 
JRA-55 is a puzzle for us. It is unlikely that the inconsistency of the temperature change 
between observational data and reanalysis data is simply a manifestation of a low quantity 
of observations in this region, since many observational data have been assimilated after 
the year of 1979. The inconsistency may rather result from the data assimilation methods 
and model details, in particular from the biases in surface radiative flux that affects the 
surface temperature inversion. Note that JRA-55 does not show any temperature change 
in the Antarctic Peninsula in the past 36 years, which is inconsistent with the observational 
temperature change. 

For the standard deviation a along the regression line, there is no dramatic difference 
between reanalysis and observation data except at Mawson and McMurdo, where the 
ERA-Interim reanalysis data slightly exaggerate the variability. Moreover, at Amundsen- 
Scott, a of JRA-55 and MERRA is 1/3 less than observational data. As a result, the 
relative temperature trend x will show a very similar picture as the absolute trend A (i.e. 
Figure 3 (a)). We have calculated our quality measure dr for the standard deviations. 
According to Table 1, dr varies between 0.27 for NCEPl and 0.18 for NCEP2, representing 
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only small deviations between reanalysis and observational data. In this case, however, 
unlike for the temperature trends, 6r = 1 does not provide the threshold for shuffled data, 
since the shuffling method yields a unchanged. 

3.2. Seasonal warming/cooling trends 

Next we address the seasonal warming/cooling trends in Antarctica. The results are 
shown in Figure 4. In the Antarctic Peninsula, the reanalysis data sets show a reasonable 
performance, as for the annual trends discussed above. An exception is again JRA-55, 
which during all seasons shows less warming trends at Faraday and Rothera than the ob¬ 
servational data. The less warming trend as reflected by JRA-55 challenges the reliability 
of its underlying model, since the observational data in this region were well assimilated af¬ 
ter the year of 1979. Moreover, NCEP2 provides higher trends at Bellingshausen than the 
observational data during austral winter; ERA-Interim shows little evidence of warming 
trends at Faraday across all seasons. 

In West and East Antarctica where the density of stations is low, the performance is 
much worse. During austral winter, the warming trends of NCEPl and NCEP2 at Byrd 
are exaggerated by a factor of 2.6 and 4.7, respectively (reaching 0.88°C and 1.58°C per 
decade). MERRA, however, does not show any temperature change during austral spring, 
which is inconsistent with the strong warming trend in the observational data. 

In East Antarctica, NCEPl and NCEP2 are unreliable in describing the temperature 
trends during non-summer seasons, where spurious warming trends are found at Halley, 
Casey and Amundsen-Scott. Moreover, JRA-55 shows considerable warming trends at 
Casey and Amundsen-Scott during austral non-summer seasons and austral summer, re¬ 
spectively. The observational data, in contrast, show either cooling (Halley and Casey) 
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or modest warming (Amundsen-Scott). ERA-Interim and MERRA perform considerably 
better, and show trends much closer to observation with slight deviations of ERA-Interim 
at Amundsen-Scott. 

We have applied our accuracy measure to the seasonal trends in the reanalysis data 
sets. The results are listed in Table 1. As for the annual trends, the accuracy of NCEP2 
is unacceptable, with (J^-values between 1.27 and 1.72. These high values can only occur 
when the reanalysis project produces warming while the observational data show cooling 
and vice versa. Surprisingly, NCEPl is slightly better, with the best performance (0.93) 
in austral spring and the worst performance in austral fall (1.94). The performance of 
JRA-55 is only slightly better, again with the worst performance (1.37) in austral summer 
and the best performance (0.82) in austral spring. In contrast, ERA-Interim and MERRA 
have a reasonable performance, where our accuracy index is below 1 for all seasons except 
austral summer. 

3.3. Persistence analysis: Lag-1 antocorrelation 

Next we consider the linearly detrended lag-1 autocorrelation function C'(l) of the 
annual temperature data and the Hurst exponent a. The reason why we consider C'(l) here 
is that it plays a central role in the conventional estimation of the statistical signihcance of 
a temperature trend as mentioned, see e.g., in the last IPCC report [Stocker et ai, 2014]. 
The statistical signihcance is crucial when one wants to assess if an observed trend is likely 
to be of anthropogenic origin or not. The main assumption in the conventional treatment 
[Santer et ai, 2000] is that the detrended lag-s-autocorrelation function C(s) of an annual 
temperature record is short-term persistent and decays, to a very good approximation, as 

C(5)=C(1)-*,s = 0,1,2,---. (4) 
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The second assumption is that also in short records C'(l) can be obtained sufficiently 
accurately. However, it has been shown [Lennartz and Bunde, 2009] that this assumption 
is not fulhlled. The accuracy in the autocorrelation function depends on the record length 
L, and the results for C'(s) are only reliable for s well below L/50. This means that in 
records of length L below 50 even C'(l) cannot be calculated reasonably well. This sheds 
doubts on the conventional significance analysis as long as short records are considered, 
even in the case that the record is short-term persistent. 

Under the condition that the record is short-term persistent, the sign of C*(l) highly 
matters. When C(l) is positive, the data are persistent. When C{1) is negative, the data 
are anti-persistent. Under the assumption that the record is long-term persistent, C*(l) 
does not play an important role, and is replaced by the Hurst exponent a. 

Figure 5 shows the linearly detrended lag-1 autocorrelation C'(l) obtained from the 
annual mean temperature data at the different stations. The figure shows that for the 
same station, C(l) fluctuates strongly in the different reanalysis projects (with a 5^-value 
even exceeding 2 for MERRA), fluctuating between positive and negative values. If the 
data were indeed short-term persistent as postulated in several articles [e.g., Bromwich 
et ai, 2013; Jones and Lister, 2015], this would imply that for the same station, some 
reanalysis projects would produce short-term persistent temperature curves, while the 
others would produce anti-persistent curves. When observing the temperature data in 
Figure 2, however, such a difference cannot be recognized, since all curves for one station 
showed the same characteristic ‘mountain-valley’ structure. For obtaining a threshold 
value for 5r, we consider again shuffled observational data where C(l) = 0. In this case. 
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as for the temperature trends considered above, 5^ = 1 is the threshold. Table 1 shows 
that except for NCEP2 where Sr is slightly below 1, all Sr values are above 1. 

Accordingly, the valne of C{1) can not describe snfhciently the strncture of the tem¬ 
perature records and thus C(l) cannot represent a central quantity for the statistical 
signihcance of the data. Following Lennartz and Bunde [2009], we believe that the large 
fluctnations in C'(l) between the different reanalysis projects are mainly produced by 
the hnite size effects in calculating C'(l), and not by different dynamical featnres in the 
reanalysis projects. 

3.4. Persistence analysis: Long-term correlations and Hnrst exponent 

The previous subsection points to the possibility that a description of the temperature 
records as short-term persistent may not be appropriate. Indeed, when analyzing the ob¬ 
servational READER data by the Detrended Flnctuation Analysis (DEA2) (see Methods 
Section for detailed mathematical descriptions) it has been shown recently [Ludescher 
et ai, 2015] that the form of the DEA2 flnctnation fnnction F{s) does not £t to the as¬ 
sumption of a short-term dependent process (where C(s) decays exponentially, as in Eq. 
4) but rather fits to the assumption of the existence of a long-term dependent process 
where the autocorrelation function C(s) decays algebraically. 


C(s) oc (1 — j)s ''', 0 < 7 < 1, s > 0. (5) 

By dehnition, C'(O) = 1, and 7 = 1 describes white noise. The autocorrelation fnnction 
C{s), however, is not a good tool for detecting long-term correlations, since strong finite- 
size effects occnr (see above), which strongly limit the validity range of s. A more reliable 
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tool is the DFA method, where one calculates a fluctuation function F{s). When F has 
the form of a power law [Peng et ai, 1994; Kantelhardt et ah, 2001], 

F{s) ~ ( 6 ) 

then this indicates a long-term persistent process, and the Hurst exponent a is related to 
the correlation exponent 7 by 

a = 1 - 7 / 2 . (7) 

For 7 between 0 and 1, a ranges between 1/2 and 1. Long-term persistence is not a 
feature of the Antarctic stations alone. Long-term persistence occurs all over the globe, 
in atmospheric temperatures as well as in sea-surface temperatures. Typical values for 
a are 0.65 for continental and coastline stations [Koscielny-Bunde et ai, 1998; Malamud 
and Turcotte, 1999; Fraedrich and Blender, 2003; Eiehner et ai, 2003; Kirdly et ai, 2006; 
Franzke, 2010, 2012; Ludescher et ai, 2015; Yuan et ai, 2015], 0.75 for island stations and 
0.8 for sea-surface temperatures [Monetti et ai, 2003]. The error bars corresponding to the 
95 percent confidence interval are ±0.10 for coast line and continental stations, ±0.15 for 
island stations, and ±0.10 for sea surface temperatures. Long-term persistence (long-term 
memory) does not only occur in temperature records, but is also known to characterize 
systems as diverse as river-flows [Hurst, 1951; Mandelbrot and Wallis, 1968; Tessier et ai, 
1996; Montanari et ai, 2000; Koutsoyiannis, 2006; Kantelhardt et ai, 2006; Koscielny- 
Bunde et ai, 2006; Mudelsee, 2007; Livina et ai, 2003], sea level heights [Beretta et ai, 
2005; Dangendorf et ai, 2014; Becker et ai, 2014], wind fields [Santhanam and Kantz, 
2005] and midlatitude cyclons [Blender et ai, 2015]. Other examples include heartbeat 
intervals [Bunde et ai, 2000; Peng et ai, 1993], DNA sequences [Peng et ai, 1992], the 
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volatility in financial markets [Lux and Ausloos, 2012], and the arrangement of rare words 
in literary texts [Ebeling and Pdschel, 1994; Altmann et ai, 2012], 

We have performed a DFA2 analysis and determined F{s) for all temperature records 
considered here. Typical result for two stations, Rothera and Dumont-Durville, are shown 
in Figure 6. The hgure shows that all fluctuation functions display the same perfect power- 
law behavior, from which we can easily extract the Hurst exponent as slope in the double- 
logarithmic plots. The result for the Hurst exponents of all records is shown in Figure 7. 
One can see that the Hurst exponents for the observable data found by us in Antarctica 
are within the ranges expected for continental, coastline and sea surface temperatures 
discussed above. The hgure shows that the Hurst exponents of the 5 reanalysis projects 
and the READER data are very close to each other, revealing that all the reanalysis 
projects are able to reproduce the long-term persistent nature of the instrumental data. 
Indeed, this may be expected from Figure 2, since the reanalysis data show the same 
characteristic ‘mountain-valley’ structure generated by the long-term memory in the data 
as the instrumental data. Our accuracy measure gives the same very low value for Sr for all 
reanalysis projects considered (see Table 1). A threshold value for Sr can be obtained, as 
for the temperature trends and 0(1), from shuffling the READER data. When shuffling, 
the long-term persistence vanishes, and the Hurst exponents become 1/2. This leads to 
the threshold value 0.31, which is above the Sr values for all reanalysis data sets. 

3.5. Significance of trends 

We have described, in the Methods Section, how the signihcance S' of a trend can be 
obtained for (a) a short-term persistent process characterized by 0(1) and (b) a long-term 
persistent process characterized by the Hurst exponent a. Despite the evidence that the 
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Antarctic temperature data are long-term persistent (see Figure 6, Franzke [2010, 2012], 
Bunde et al. [2014], Ludescher et al. [2015] and Yuan et al. [2015]), we discuss the sig¬ 
nificance level of warming/cooling trends also for the hypothetical case of short-term 
persistence. 

The results for the p-values (p = 1 — (S') are shown in Figure 8: (a) under the hypothesis 
that the data are short-term persistent; and (b) for the assumption that the data are 
long-term persistent. We would like to emphasize that this result is only valid for the 
considered time window of 36-yr, since our purpose is to assess the skills of reanalysis 
data sets. For most observational records the time window is indeed longer. Since the 
statistical significance of a trend increases with increasing length, the significance of the 
observational trend in the full time window might be larger than for the considered time 
window (see Methods Section and Tamazian et al. [2015]). 

Under hypothesis (a), only the observational records at Faraday and Dumont-Durville 
have p-values below 0.05 and are thus statistically significant. In contrast, NCEPl, 
NCEP2, and JRA-55 produce highly significant trends at several stations in West and 
East Antarctica. As expected from Figure 3, the ERA-Interim and MERRA data sets 
produce more realistic trend significances. There are only few exceptions, for example 
ERA-Interim at Amundsen-Scott implies a significant cooling trend that is not observed 
in reality; MERRA exhibits a significant warming trend at Mawson. 

Under the more realistic assumption (b), all observational records have p-values even 
above 0.1, and thus the warming/cooling trends are not statistically significant in the 
considered time window. It is remarkable that despite all their differences, in the Antarctic 
Peninsula, the reanalysis data produce a comparable significance level, revealing that in 
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the time period after 1979, the warming in the Peninsula is not signihcant. In the rest of 
Antarctica, however, NCEPl and NCEP2 again show signihcant spurious warming trends 
at many stations. At Halley NCEP2 produces highly signihcant trends with p below 
0.05. In contrast, the observational data have p values above 0.1, and the contrast could 
hardly be higher. Again, JRA-55 shows signihcant warming at Casey and Amundsen- 
Scott (p < 0.05). ERA-Interim (except at Amundsen-Scott) and MERRA (except at 
Mawson) perform much better. 

4. Conclusions 

In this paper, we assessed, for the hrst time, the warming trend and its signihcance as 
well as the persistence properties of hve widely used global reanalysis datasets (NCEPl, 
NCEP2, ERA-Interim, JRA-55 and MERRA) in Antarctica. We considered the time pe¬ 
riod from January 1979 to December 2014, when modern satellite data were assimilated 
into the reanalysis datasets. We compared the reanalysis datasets with the longest obser¬ 
vational T 2 m data from stahed observation stations across Antarctica. In our performance 
test, we hrst compared the absolute trends A and the standard deviation along the re¬ 
gression line a. Then we considered the seasonal warming trends. Finally, we studied the 
persistence properties (lag-1 autocorrelation C(l) and Hurst exponent a) as well as the 
signihcance level (p-value) of the relative trends. 

We found that all 5 reanalysis data sets were able to reproduce nicely the long-term 
persistence in the instrumental data, with Hurst exponents quite close to each other. Also, 
the standard deviations along the regression lines are in very good agreement between 
reanalysis and instrumental data sets. In contrast, C'(l), which is needed as input for 
the conventional signihcance analysis shows fully erratic behavior, and the observational 
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warming/cooling trends in East and West Antarctica (where the data are sparse) are 
not reproduced well by the reanalysis data sets. The worst performance showed NCEPl, 
NCEP2, and JRA-55 with spurious warming trends even in those parts of East Antarctica 
where cooling has been observed. In the Peninsula where the station density is quite high, 
the performance of the reanalysis data is considerably better. Under the assumption of 
a long-term persistent process all reanalysis data sets as well as the observational data 
show that in the considered time period since 1979 the warming in the Peninsula is not 
signihcant with p values well above 0.1. 

Overall, ERA-Interim and MERRA showed the best performance when testing the local 
temperature data in Antarctica. Eurther work is needed in order to see if the data sets 
are also better in reproducing the known teleconnections between locations on different 
parts of the globe. 

5. Methods 

In earlier studies on Antarctic warming [e.g., Steig et ai, 2009; Ding et ai, 2011; 
Bromwich et ai, 2013; Nicolas and Bromwich, 2014; Jones and Lister, 2015], it has been 
assumed that the linearly detrended annual mean temperatures Qi can be described by a 
hrst-order autoregressive process (AR(1)), which is dehned as 

Oi+i = riOi+ pi,i = 1,2,-■ ■ ,L - 1, (8) 

where ri is the AR(1) persistence parameter lying between -1 and 1, and pi is Gaussian 
white noise. The data are persistent if ri >0 and anti-persistent if ri < 0. For ri = 0, they 
represent Gaussian white noise. The autocorrelation function of the linearly detrended 
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record is defined as 


7^ Ef-/ 0*0*+. 

c(.) = (0.0.+.) = "-rr; , 

r 2^.=1 Y'j 


( 9 ) 


where s represents the time lag. It can be shown that for AR(1) processes, in the limit 
of L —)■ cx), C(s) decays exponentially, C(s) = = exp(—s|lnri|) = exp(—s/sx), where 

+1 is identical to the lag-1 autocorrelation C{1) and Sx = 1 /| lnri| is the persistence time. 
Accordingly, for an AR(1) process, C{1) is the relevant quantity, as long as L is sufficiently 
large (which according to Bunde et al. [2014] and Ludescher et al. [2015], however, is not 
the case for the annual Antarctic records). When assuming the relation ri = C'(l), the 
signihcance S of the relative trend x can be written as [Santer et al, 2000; Tamazian 
et al, 2015] 




^ /l 1 , ,3 ix/aY' 

X 2 


( 10 ) 


Here, F denotes the Gamma function, and 2 F 1 is the hypergeometric function [Tamazian 
et al, 2015]. The effective length 1{L) is 1{L) = L — 2, and the scaling parameter a 
is given by 

Vl2{L - 1 ) 1 


a = 


( 11 ) 


VT2 + 2 

However, it has been argued recently that the temperature records in Antarctica [Bunde 
et al, 2014; Tamazian et al, 2015; Ludeseher et al, 2015; Yuan et al, 2015], as well as 
in other places of the globe are not short-term, but long-term persistent [e.g., Koseielny- 
Bunde et al, 1998; Eichner et al, 2003; Fraedrieh and Blender, 2003]. In a long-term 
persistent stationary process, the autocorrelation function decays algebraically as G(s) = 
(1 — 7 ) 5 “'’', where the correlation exponent 7 is between 0 and 1. For detecting long-term 
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memory one usually does not consider (^(s) because it exhibits strong finite size effects, 
but the detrended ffuctuation analysis called DFA [Peng et ai, 1994; Kantelhardt et ai, 
2001]. The current standard method for detecting long-term memory in climate records 
is DFA2 [Kantelhardt et ai, 2001], which is a modification of DFA [Peng et ai, 1994] and 
eliminates linear external trends. 

In DFA2, one considers the monthly temperature anomalies Tj,i = 1,2, ••■A^ where 
the seasonal trend has been subtracted from the data. Then one determines the “profile” 
^i = 1,2, ■ ■ ■, N. To obtain the fluctuations of Y on time scales of length 
s one divides the record into Ng equal non-overlapping segments of fixed length s. In 
each segment u = 1,2, ■ ■ ■, Ng, one calculates the best quadratic fit f,y{i) of the profile and 
determines the variance 

=1 i: iy((>' -1)5+j) i)s+ j))f (12) 

j=i 

around the fit. Averaging Fg{v) over all Ng segments then gives the square of the desired 
fluctuation function F{s). 

The behavior of F{s) depends on how the autocorrelation function C'(s) decays with 
s. If C'(s) decays exponentially, then F{s) increases as F{s) oc for s well above the 
persistence time Sx- In the case of long-term correlations, F{s) increases as 

F{s) oc (13) 

with the Hurst exponent a = 1 — 7/2 > 0.5 (the higher the value of a, the stronger the 
long-term memory). The results for F{s) are reliable for s between 7 and A^/4 [Kantelhardt 
et ai, 2001]. 
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The Detrended Fluctuation Analysis (DFA2) has been applied to a large number of 
temperature records all over the globe [e.g., Koscielny-Bunde et ai, 1998; Fraedrich and 
Blender, 2003; Eichner et ai, 2003; Lovejoy and Schertzer, 2013] revealing the long-term 
persistent nature of temperature records. It has been shown in Vyushin et al. [2004] that 
a major cause of the long-term memory is volcanic forcing. 

DFA2 has been also applied to the monthly Antarctic records considered here in Bunde 
et al. [2014], Bromwich and Nicolas [2014], Ludescher et al. [2015], Yuan et al. [2015], and 
Tamazian et al. [2015]. It has been shown explicitly in Bunde et al. [2014] and Ludescher 
et al. [2015] that for each record, the fluctuation function F{s) agreed with the fluctuation 
function of long-term correlated surrogate data with the same length and Hurst exponent 
a. 

It has been shown in Rybski et al. [2008] when considering millennium runs that the 
Hurst exponent was the same for monthly, annual and bi-annual data, i.e. did not depend 
on the length of the averaged region in the time series. For a meaningful DFA analysis, 
the length of the record should not be smaller than 400 data points, and thus for the 
Antarctic stations we can consider only monthly data. 

When a record is fully characterized by a certain Hurst exponent a, the significance 
S' of a relative trend x depends only on a and the record length N. It has been shown 
recently by Tamazian et al. [2015] that S{x,N) also follows Eq. 10, but with different 
parameters a and 1. These parameters depend on a and N and have been tabulated (for 
0.5 < a < 1.5) and N > 400 in Tamazian et al. [2015]. Accordingly, for given a and N, the 
trend significance can be obtained straightforwardly from Tamazian et al. [2015], making 
the trend estimation as easy as for short-term persistent processes. Analytic approximate 
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formulas for the significance of the trends in long-term persistent records can be found in 
Lennartz and Bunde [2009, 2011]. 
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Figure 1. The locations of the stations. The linear regression analysis (A) of 
temperature change from January 1979 to December 2014 and the Detrended Fluctuation 
Analysis (DFA2) (Hurst exponent a) are shown (A/a) The color represents A with the 
units degrees of Celsius per decade. 
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Figure 2. Comparison between annual observational T 2 m time series (blue) and 5 
reanalysis projects (NCEPl - black, NCEP2 - red, ERA-Interim - magenta, JRA55 - 
green and MERRA - cyan) for 4 stations, (a) Dumont-Durville, (b) Amundsen-Scott, (c) 
McMurdo, and (d) Rotliera. The trend lines have been obtained by linear regression. 
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Figure 3. Comparison of (a) the absolute trend A per decade, (b) the standard deviation 
a around the regression line and (c) the relative trend x = A/a between observation 
data and reanalysis datasets at different stations. Bellingshausen, Dumont-Durville and 
Amundsen-Scott are abbreviated to Bell, DD and AS, respectively. The units of A and a 
are degree Celsius. 
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Figure 4. Same as Figure 3a, but for (a) austral summer (DJF), (b) austral autumn 
(MAM), (c) austral winter(JJA) and (d) austral spring (SON). 
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Figure 

data. 




5. Same as Figure 3, but for lag-1 autocorrelation C'(l) of detrended annual 




s (month) s (month) 

Figure 6. Persistence analysis (DFA2). The figure shows the DFA2 fluctuation func¬ 
tions F{s) for two representative stations (a) Rothera, and (b) Dumont-Durville. The 
fluctuation functions can be well approximated, for s above 10, by a power-law depen¬ 
dence. 
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Figure 7. Same as Figure 3, but for the DFA2 Hurst exponent a of the monthly 
temperature anomalies. 



Figure 8 . Same as Figure 3, but for the p-value of the relative trend x, when assuming 
(a) an AR(1) process and (b) a long-term persistent process. 
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Table 1. The dimensionless relative standard error 6r = Se/Sq for annual trend, 
seasonal trend, standard deviation around the regression line, Hurst exponent a, as well 
as the lag-1 autocorrelation function C(l). The red 6r are the ones with value smaller 
than the 5% signihcance level of the null model. 
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